Putting theory oriented evaluation into practice

Evaluations of gaming simulations and business games as teaching devices are typically end-state driven. This emphasis fails to detect how the simulation being evaluated does or does not bring about its desired consequences. This paper advances the use of a logic model approach which possesses a holistic perspective that aims at including all elements associated with the situation created by a game. The use of the logic model approach is illustrated as applied to Simgame, a board game created for secondary school level business education in six European Union countries

Combining decision trees and stochastic curtailment for assessment length reduction of test batteries used for classification.

For classification problems in psychology (e.g., clinical diagnosis), batteries of tests are often administered. However, not every test or item may be necessary for accurate classification. In the current article, a combination of classification and regression trees (CART) and stochastic curtailment (SC) is introduced to reduce assessment length of questionnaire batteries. First, the CART algorithm provides relevant subscales and cutoffs needed for accurate classification, in the form of a decision tree. Second, for every subscale and cutoff appearing in the decision tree, SC reduces the number of items needed for accurate classification. This procedure is illustrated by post hoc simulation on a data set of 3,579 patients, to whom the Mood and Anxiety Symptoms Questionnaire (MASQ) was administered. Subscales of the MASQ are used for predicting diagnoses of depression. Results show that CART-SC provided an assessment length reduction of 56%, without loss of accuracy, compared with the more traditional prediction method of performing linear discriminant analysis on subscale scores. CART-SC appears to be an efficient and accurate algorithm for shortening test batteries. © The Author(s) 2013

Electrode positions, transformation coordinates for ECG reconstruction from S-ICD vectors.

The article contains data pertaining to the reconstruction of an 8-lead ECG from 2 subcutaneous implantable cardioverter defibrillator vectors. The location of electrodes on the precordium required for the data collection are detailed; the flow chart for patient selection and exclusion is shown; the summary data of the root mean square error (RMSE) (in microvolts) and Pearson r for the ECG transformation all cases and the pearson correlation for all the leads measured and reconstructed leads are also shown. Detailed background, methodology and discussion can be found in the linked research article

Difference score correlations in relationship research: A conceptual primer

The practice of computing correlations between “difference” or “discrepancy” scores and an outcome variable is common in many areas of social science. Relationship researchers most commonly use difference scores to index the (dis)similarity of members of two-person relationships. Using an intuitive, graphical approach—and avoiding formulas and pointing fingers—we illustrate problems with using difference score correlations in relationship research, suggest ways to ensure that difference score correlations are maximally informative, and briefly review alternatives to difference score correlations in studying similarity, accuracy, and related constructs.Peer Reviewedhttp://deepblue.lib.umich.edu/bitstream/2027.42/73008/1/j.1475-6811.1999.tb00206.x.pd

The standard error of measurement is a more appropriate measure of quality for postgraduate medical assessments than is reliability: an analysis of MRCP(UK) examinations

Background: Cronbach's alpha is widely used as the preferred index of reliability for medical postgraduate examinations. A value of 0.8-0.9 is seen by providers and regulators alike as an adequate demonstration of acceptable reliability for any assessment. Of the other statistical parameters, Standard Error of Measurement (SEM) is mainly seen as useful only in determining the accuracy of a pass mark. However the alpha coefficient depends both on SEM and on the ability range (standard deviation, SD) of candidates taking an exam. This study investigated the extent to which the necessarily narrower ability range in candidates taking the second of the three part MRCP(UK) diploma examinations, biases assessment of reliability and SEM.Methods: a) The interrelationships of standard deviation (SD), SEM and reliability were investigated in a Monte Carlo simulation of 10,000 candidates taking a postgraduate examination. b) Reliability and SEM were studied in the MRCP(UK) Part 1 and Part 2 Written Examinations from 2002 to 2008. c) Reliability and SEM were studied in eight Specialty Certificate Examinations introduced in 2008-9.Results: The Monte Carlo simulation showed, as expected, that restricting the range of an assessment only to those who had already passed it, dramatically reduced the reliability but did not affect the SEM of a simulated assessment. The analysis of the MRCP(UK) Part 1 and Part 2 written examinations showed that the MRCP(UK) Part 2 written examination had a lower reliability than the Part 1 examination, but, despite that lower reliability, the Part 2 examination also had a smaller SEM (indicating a more accurate assessment). The Specialty Certificate Examinations had small Ns, and as a result, wide variability in their reliabilities, but SEMs were comparable with MRCP(UK) Part 2.Conclusions: An emphasis upon assessing the quality of assessments primarily in terms of reliability alone can produce a paradoxical and distorted picture, particularly in the situation where a narrower range of candidate ability is an inevitable consequence of being able to take a second part examination only after passing the first part examination. Reliability also shows problems when numbers of candidates in examinations are low and sampling error affects the range of candidate ability. SEM is not subject to such problems; it is therefore a better measure of the quality of an assessment and is recommended for routine use

Factor structure and construct validity of the Adult Social Care Outcomes Toolkit for Carers (ASCOT-Carer)

Background: The ASCOT-Carer is a self-report instrument designed to measure social care-related quality of life (SCRQoL). This article presents the psychometric testing and validation of the ASCOT-Carer four response-level interview (INT4) in a sample of unpaid carers of adults who receive publicly-funded social care services in England. Methods: Unpaid carers were identified through a survey of users of publicly-funded social care services in England. 387 carers completed a face-to-face or telephone interview. Data on variables hypothesised to be related to SCRQoL (for example, characteristics of the carer, cared-for person and care situation) and measures of carer experience, strain, health-related quality of life and overall QoL were collected. Relationships between these variables and overall SCRQoL score were evaluated through correlation, ANOVA and regression analysis to test the construct validity of the scale. Internal reliability was assessed using Cronbach’s alpha and feasibility by the number of missing responses. Results: The construct validity was supported by statistically significant relationships between SCRQoL and scores on instruments of related constructs, as well as with characteristics of the carer and care recipient in univariate and multivariate analyses. A Cronbach’s alpha of 0.87 (7 items) indicates that the internal reliability of the instrument is satisfactory and a low number of missing responses (<1%) indicates a high level of acceptance. Conclusions: The results provide evidence to support the construct validity, factor structure, internal reliability and feasibility of the ASCOT-Carer INT4 as an instrument for measuring social care-related quality of life of unpaid carers who care for adults with a variety of long-term conditions, disability or problems related to old age

The merger of vertically offset quasi-geostrophic vortices

We examine the critical merging distance between two equal-volume, equal-potential-vorticity quasi-geostrophic vortices. We focus on how this distance depends on the vertical offset between the two vortices, each having a unit mean height-to-width aspect ratio. The vertical direction is special in the quasi-geostrophic model (used to capture the leading-order dynamical features of stably stratified and rapidly rotating geophysical flows) since vertical advection is absent. Nevertheless vortex merger may still occur by horizontal advection. In this paper, we first investigate the equilibrium states for the two vortices as a function of their vertical and horizontal separation. We examine their basic properties together with their linear stability. These findings are next compared to numerical simulations of the nonlinear evolution of two spheres of potential vorticity. Three different regimes of interaction are identified, depending on the vertical offset. For a small offset, the interaction differs little from the case when the two vortices are horizontally aligned. On the other hand, when the vertical offset is comparable to the mean vortex radius, strong interaction occurs for greater horizontal gaps than in the horizontally aligned case, and therefore at significantly greater full separation distances. This perhaps surprising result is consistent with the linear stability analysis and appears to be a consequence of the anisotropy of the quasi-geostrophic equations. Finally, for large vertical offsets, vortex merger results in the formation of a metastable tilted dumbbell vortex.Publisher PDFPeer reviewe

Relationship between psychological and biological factors and physical activity and exercise behaviour in Filipino students

The aim of the present study was threefold. Firstly, it investigated whether a general measure or specific measure of motivational orientation was better in describing the relationship between motivation and exercise behaviour. Secondly, it examined the relationship between the four most popular indirect methods of body composition assessment and physical activity and exercise patterns. Thirdly, the interaction between motivation and body composition on physical activity and exercise behaviour was explored in a sample of 275 Filipino male and female students. Males were found to have higher levels of exercise whereas females had higher levels of physical activity. Furthermore, general self-motivation together with body weight and percentage body fat were found to be the best predictor of exercise behaviour whereas the tension/pressure subscale of the ‘Intrinsic Motivation Inventory’ (IMI) was the best predictor of levels of physical activity. However, significant gender differences were observed. That is, for the males only self-motivation and for the females only body weight and BMI predicted exercise behaviour. Also, tension/pressure predicted physical activity levels for the females but not the males. No inverse relationship was found between the four body composition measures and exercise and physical activity behaviour. The results support the notion that the psychobiological approach might be particularly relevant for high intensity exercise situations but also highlights some important gender differences. Finally, the results of this study emphasise the need for more cross-cultural research

The impact of next and back buttons on time to complete and measurement reliability in computer-based surveys

To assess the impact of including next and back buttons on response burden and measurement reliability of computer-based surveys. A sample of 807 participants (mean age of 53; 64% women, 83% non-Hispanic white; 81% some college or college graduates) from the YouGov Polimetrix panel was administered 56 items assessing performance of social/role activities and 56 items measuring satisfaction with social/role activities. Participants were randomly assigned to either (1) automatic advance to the next question with no opportunity to go back (auto/no back); (2) automatic advance to the next questions with an opportunity to go back (auto/back); (3) next button to go to the next question with no opportunity to go back (next/no back); or (4) next button to go to the next question with an opportunity to go back (next/back). We found no difference in missing data, internal consistency reliability, and domain scores by group. Time to complete the survey was about 50% longer when respondents were required to use a next button to go on. Given the similarity in missing data, reliability and mean scale scores with or without use of the next button, we recommend automatic advancement to the next item with the option to go back to the previous item

Perfectionism and achievement goals in young Finnish ice-hockey players aspiring to make the Under-16 national team

Research on perfectionism suggests that is it useful to differentiate between perfectionistic strivings and perfectionistic concerns. Regarding the 2 x 2 achievement goal framework, the usefulness of this differentiation was recently demonstrated in a study with university student athletes (Stoeber, Stoll, Pescheck, & Otto, 2008, Study 2), in which it was found that perfectionistic strivings were associated with mastery-approach and performance-approach goals and perfectionistic concerns with mastery-avoidance, performance-approach, and performance-avoidance goals. Because the study was largely exploratory and only used non-elite athletes, the aim of the present research was to replicate and extend these findings by investigating a sample of 138 young, elite ice-hockey players, while adding further measures of perfectionism and using structural equation modelling (SEM) to confirm the relationships between perfectionistic strivings, perfectionistic concerns,and the 2 x 2 achievement goals. The SEM results showed that, in elite athletes also, perfectionistic strivings are associated with mastery-approach and performance-approach goals, whereas perfectionistic concerns are associated with masteryavoidance, performance-approach, and performance-avoidance goals. Our findings corroborate the importance of differentiating between perfectionistic strivings and perfectionistic concerns when studying perfectionism in sports, because only perfectionistic concerns (and not perfectionistic strivings) are associated with maladaptive patterns of achievement goals